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Abstract 

We describe adaptive control algorithms whereby a chaotic dynam- 
ical system can be steered to a target state with desired characteristics. 
A specific implementation considered has the objective of directing the 
system to a state which is more chaotic or mixed than the uncontrolled 
one. This methodology is easy to implement in discrete or continuous 
dynamical systems. It is robust and efficient, and has the additional 
advantage that knowledge of the detailed behaviour of the system is 
not required. 



Adaptive control algorithms have hitherto been implemented for the pur- 
pose of maintaining periodic behaviour in nonlinear systems [|. Re- 
cently there has been some interest in control algorithms whose aim is to tar- 
get other types of dynamical behaviour. "Anti-control" algorithms, namely 
those wherein the objective is to maintain 0] or to enhance || the chaoticity 
of dynamical systems have been devised. These efforts have been motivated 
by practical situations where the enhancement or maintenance of chaos has 
desirable consequences. Examples of these can be found in contexts as di- 
verse as mixing flows 0, electronic systems JFj and chemical reactions ||, 
where the enhancement of chaos can lead to improved performance, or in 
biological applications such as in neural systems, where the maintenance of 
chaos provides the key to the avoidance of pathological behaviour f||]. 

In this paper we describe an adaptive anti-control algorithm which is 
simple and easily implemented. The algorithm is set up to maintain a de- 
sired level of chaoticity, and to achieve a target value of the local Lyapunov 
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exponent or a local stretching rate. The technique is sufficiently general and 
can be extended so as to make a given dynamical system achieve a target 
value of any desired variable or function. 

In the context of nonlinear dynamical systems, the method of adaptive 
control |I| applies a feedback loop in order to drive the system parameter 
(or parameters) to the values required so as to achieve a desired or target 
state. This is implemented by augmenting the evolution equation for the 
dynamical system by an additional equation for the evolution of the param- 
eter (s) as described below. 

Consider a general iV-dimensional dynamical system described by the 
evolution equation 

X = F(X;p;t) (1) 

where X = (X±,X2, ■ ■ -Xn) are the state variables and // is the parameter 
whose value determines the nature of the dynamics. The adaptive control is 
effected by the additional dynamics 

A = e{V* - V) (2) 

where V* is the target value of some variable or property (which could be 
a function of several variables) V, and the value of e indicates the stiffness 
of control. The extension to the situation of several control parameters is 
st r aight f or war d . 

The scheme is adaptive since in the above procedure the parameters which 
determine the nature of the dynamics self- adjust or adapt themselves to yield 
the desired dynamics. This has also been termed "dynamic feedback con- 
trol" in the literature fL0 |. The adaptive principle is remarkably robust and 



efficient in generic nonlinear systems 0, and may therefore be of consider- 
able utility in a large variety of phenomena, ranging from biological units to 
control engineering. 

For the maintenance of a stable fixed point [I] in a discrete dynamical 
system for example, the procedure is as follows. The nonlinear system evolves 
according to the appropriate equation, 

x n+ i = f{a,x n ) (3) 

where a is the parameter to be controlled. If the required value of x is, say, 
x*, then the additional equation (for V = x) 

a n+ i = a n + e(x* - x n ) (4) 
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has the desired effect of tuning the value of a so that the dynamics of the 
combined equations gives x — > x* over a wide range of initial conditions. The 
stiffness e determines how rapidly the system is controlled. The control time, 
defined as the time required to reach the desired state, is crucially dependent 
on the value of e. Numerical experiments show that for small e the recovery 
time is inversely proportional to the stiffness of control. This follows from the 
fact that when e is small compared to the inverse timescales in the original 
dynamical system, we can use an adiabatic approximation since fi — > 0, from 
which |10| it follows that control time will be proportional to 1/e. 

With modifications, this method can be made to control to a stable or 
unstable periodic orbit of arbitrary period @, [LC], [TT[ . 



If the desired target state is chaotic rather than periodic, one needs to 
choose an appropriate property V which should reflect the desired chaotic 
nature of the target state. Therefore the natural choice of V is the Lyapunov 
exponent. It is thus clear that in order to achieve a desired value of the 
Lyapunov exponent, say A*, the procedure to be followed is similar (with 
V = X). 

For a 1-d discrete dynamical system as in Eq. @ above, the Lyapunov 
exponent is defined through, 

i N-l 

x = ] im Tr£M/'(«,*i)l- (5) 

The control equation (^) takes the form 

a n+ i = a n + e(A* - A n ), (6) 

where A n = In \f'(a,x n )\ is the instantaneous value of the Lyapunov expo- 
nent. Implementation of the methodology in, say, the logistic equation, is 
direct and the relevant equations are 

x n+ i = a n x n (l - x n ) (7) 
A n = ln|a n (l - 2x n )\ (8) 
a n+1 = a n + e(X*-X n ). (9) 

Shown in Fig. 1 is an implementation of the control for A* = 0.36. Since 
X(a) for the logistic equation is a highly nonmonotonic function, there can 
be several parameter values for which the system has the same A, namely 
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several different attractors with the same Lyapunov exponent are possible. 
For example, the Lyapunov exponent is approximately 0.36 at a ~ 3.7 as 
well as at a ~ 3.86. Which of these values the system adaptively goes to 
depends on the initial state, the stiffness and the effective basin of attraction 
(in parameter space). For small stiffness, the system sticks closely to one or 
the other attractor, only occasionally making an excursion from one to the 
other, while for large stiffness, the fluctuations in the parameter are much 
larger, as can be seen in Fig. 1. For small values of stiffness the time taken 
to reach the desired goal is usually inversely proportional to the stiffness of 
control. Note however that increasing stiffness beyond a point can make 
the method unstable and the dynamics unbounded. There is, therefore, an 
optimal strategy to be employed. While the optimal strategy to be used can 
be worked out easily in a practical implementation, an analytic optimality 
criterion is difficult to define. 

The distribution of finite-time Lyapunov exponents shows that the short- 
time chaoticity properties of the adaptive system can be quite different from 
the equivalent chaotic system. Shown in Fig. 2 are the distributions of adap- 
tively controlled systems with the above average A = 0.36, and with different 
stiffness, for 20 and 50 steps respectively. While the desired A is maintained 
in all cases, it is clear that the adaptation works differently for large or small 
stiffness. Low stiffness allows the system to explore different attractors with 
different properties, giving a wider spread in the Lyapunov exponents, while 
a higher stiffness ensures that the local A ~ A*, narrowing the distribution. 

Extensions of this procedure can be made to control higher dimensional 
systems. 

The fact that the control is always operative means that the augmented 
system is robust to perturbations. Indeed, if the parameter is perturbed to 
a very different value, the system readily and rapidly recovers to a dynamics 
such that the Lyapunov exponent is (nearly) A*, again with time that in- 
versely depends on e. Note however that this control works only in the case 
of positive A*: one cannot adaptively control in this manner to a periodic 
orbit. 

An application of practical importance is in enhancing the mixing in 
chaotic systems. The appropriate adaptive strategy then is to take V to be 
the stretching rate. Eq. (|2|) thus becomes 




(10) 



4 



where TZi OC ai is the instantaneous local stretching rate, and TZ tar get is the 
prescribed desired stretching rate, which can in principle be in any one of 
the dynamical variables characterizing the system. 
As an example, consider the Lorenz attractor, 

x = a(y — x) 
y = fix — y — xz 

z = xy — bz (11) 
Choosing the evolution equation for the parameter to be 

fl = eijltarget ~ x) (12) 

where the instantaneous stretching rate TZi oca i = with x given by the 
evolution equation (0), achieves the objective. Note that instead of the x 
direction, y or z can equally effectively be used in the above control. 

In the absence of knowledge of the evolution equation the above control 
can be effected by the discrete evolution equation 

Ht+6t = lh + ^'target ~ Ax t) (13) 

where Ax t is the local stretching given by \\x t — x t st\\ {St small) where 

^target = $t X 1Z target . 

Shown in Fig. 3 is the result of an implementation of this adaptive anti- 
control equation fllBD where the target stretching rate is specified to be 1.0 
with the control stiffness e = 0.1. As can be seen, the controlled parameter 
first rapidly climbs (the rate of ascent being directly proportional to 1/e) 
from an initial value /x = 35.0. Around /i ~ 380 , it settles into fluctuations 
which are of the integrated white noise type {i.e. the power spectrum of the 
time series of these fluctuations is clearly S(f) ~ l// 2 ) lead to a very mixed 
system. Starting off with any other value of /x leads to the same result, as 
does control via equation fll2|) using the relation between TZtarget and TV target 
defined above. 

The nature of adaptive anti-control is such that the dynamics that ob- 
tains is intrinsically mixing. In contrast with similar techniques where a 



stable state is targetted, the present mechanism |Tj| essentially drags the 
system rapidly to the first appropriate state encountered in parameter space, 
namely one which matches the targetted local stretching rate. The system, 
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in effect moves from (chaotic) attractor to attractor, with significant fluctu- 
ations in the parameter that is being controlled. By choosing a small target 
stretching rate, this same control mechanism can be used to obtain cycles 
as well. Somewhat fuzzy cycles are obtained, with the fuzziness decreasing 
with decreasing e. 

It should be emphasized that knowledge of the map in the control al- 
gorithm above is in principle not required, since the necessary information 
required to implement adaptive anti-control is simply the difference between 
the current value of the variable and its previous value. On the other hand, 
it is essential that the parameter \x being controlled must have the driving 
power in order to effect large dynamical changes. Parameters which are suit- 
able for controlling are easy to identify through the appropriate dynamical 
phase diagrams. 

In summary, we have presented here an adaptive algorithm which can be 
used to achieve desired chaotic behaviour in nonlinear dynamical systems. 
The anti-control technique, which is rapid, powerful and robust, extends 
adaptive control methods for obtaining periodic orbits |1|, |2], [11]. We have 
applied this to the case of achieving a target value of the Lyapunov exponent, 
or a desired value of the local streching rate and found that the methodol- 
ogy is successful in a number of examples, including multidimensional and 
multiparameter systems. 

An important consideration is that the present method can be imple- 
mented without explicit knowledge of the dynamics. The possibility of treat- 
ing the system as a black-box is likely to be of utility in complex experimental 
applications [§, ||] necessitating the controlled maintainence or enhancement 
of chaos. 
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Figure Captions 



Fig. 1 Variation of the parameter a as a function of iteration step. The target 
Lyapunov exponent is A* = 0.36, and the stiffness is a) e = 0.001, and 
b) e = 0.01. The different curves correspond to different initial a. In 
all cases, the target A* is achieved rapidly and maintained. 

Fig. 2 Probability distribution for finite time or iV-step Lyapunov exponents 
in the adaptively controlled system. The target Lyapunov exponent is 
A* = 0.36 as in Fig. 1. a) N — 20 and b) N = 50 correspond to a 
stiffness of e = 0.001, while c) N = 20 and d) N = 50 correspond to a 
stiffness of e = 0.01. 

Fig. 3 Variation of the parameter fi as a function of time for the Lorenz at- 
tractor. The target stretching rate is 1.0, the stiffness is e = 0.1 and 
the time step is dt = 0.01. 
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